Fast Response and Temporal Coding on Coherent Oscillations in Small- World 

Networks 



(N 
"a 

C/3 



I 

o 



> 
as 

m 

On 
O 
On 



o 
o 



X 
J3 



Luis F. Lago-Fernandez^^\ Ramon Huerta^^'^-', Fernando Corbacho^^\ and Juan A. Sigiienza*^^) 
(1) Grupo de Neurocomputacion Biologica (GNB), E.T.S. de Ingenieria Informdtica, Universidad Autdnoma de Madrid, 

28049 Madrid (SPAIN). 

(2) Institute for Nonlinear Science, University of California, San Diego, La Jolla, CA 92093-0402 

(February 1, 2008) 

We have investigated the role that different connectivity regimes play on the dynamics of a 
network of Hodgkin-Huxley neurons by computer simulations. The different connectivity topologies 
exhibit the following features: random connectivity topologies give rise to fast system response yet 
are unable to produce coherent oscillations in the average activity of the network; on the other 
hand, regular connectivity topologies give rise to coherent oscillations and temporal coding, but 
in a temporal scale that is not in accordance with fast signal processing. Finally, small-world 
(SW) connectivity topologies, which fall between random and regular ones, take advantage of the 
best features of both, giving rise to fast system response with coherent oscillations along with 
reproducible temporal coding on clusters of neurons. Our work is the first, to the best of our 
knowledge, to show the need for a small-world topology in order to obtain all these features in 
synergy within a biologically plausible time scale. 

PACS numbers; 05.45.-a, 87.10. -l-e, 87.18.Bb, 87.18. Sn 



In a recent letter by Watts and Strogatz j^] it 
was shown that small-world networks enhance signal- 
propagation speed, computational power, and synchro- 
nizability. Small-world stands for a network whose con- 
nectivity topology is placed somewhere between a regular 
and a completely random connectivity. The main proper- 
ties of these specific networks are that they can be highly 
clustered like regular networks and, at the same time, 
have small path lengths like random ones. Therefore, 
small-world networks may have properties given neither 
in regular nor in random networks . 

In this letter we have extended Watts and Strogatz 's 
general framework by introducing dynamical elements in 
the network nodes. Our source of inspiration is based 
on a phenomena observed in the olfactory antennal lobe 
(AL) of the locust discovered by Gilles Laurent and col- 
laborators [||-|9j. The AL is a group of around 800 neu- 
rons whose functional role is to relay information from 
the olfactory receptors to higher areas of the brain for 
further processing. Three main features have been ob- 
served in the dynamics of the AL. First, there is a fast 
response of the AL when the stimulus is presented. Sec- 
ond, when an odour is presented to the insect, coherent 
oscillations of 20 Hz in the local field potential (LFP) 
are measured Third, every neuron responds to the 
odour with some particular timing with respect to the 
LFP j^. Summarizing: fast response of coherent oscil- 
lations along with temporal coding are observed. There 
are also other systems in the brain that present coherent 
LFP oscillations, hence, hinting to the generality of these 
phenomena (see [To| ] for a review). 

The cooperative behavior of large assemblies of dynam- 
ical elements has been the subject of many investigations 
pd]-p^ . In all of them the connectivity between the ele- 



ments of the network was either regular (local or global 
all-to-all), or random. However, none of these studies in- 
corporates a comparative analysis of network dynamics 
for all the different connectivity topologies. 

In the present work we pretend to show that in order 
to provide fast response, coherent oscillations and tem- 
poral coding a small-world topology is required. We will 
show that the regular connectivity topology provides a 
slow response to the external input. Although it is able 
to produce temporal coding and coherent oscillations, the 
time of formation of the oscillations would imply much 
slower responses than those observed in biological sys- 
tems. On the other hand, for the completely random con- 
nectivity case the responsiveness of the system is highly 
increased and temporal variations in clusters activity are 
present, but the coherent oscillations tipically observed 
in the LFP are lost. Without these coherent oscillations 
the AL seems to lose its ability to process the information 
incoming from the sensors 0. 

The model we propose for this study is made of an 
array of non-identical Hodgkin-Huxley elements coupled 
by excitatory synapses. The unit dynamics is described 
by the following set of coupled ordinary differential equa- 
tions: 

(1) 



m = amiV){l - m) - f3rniV)m 



h = an{V)il - h) - l3h{V)h 



= an{V){l - n) - l3n{V)r 
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where Vi represents the membrane potential of unit i; 
Cm is the membrane capacitance per unit area; I'^it) 
is the external current, which occurs as a pulse of am- 
plitude Iq; I'^{t) is the synaptic current; Vr = Vi — Vr, 
where Vr are the equilibrium potentials for the different 
ionic contributions (r = L,Na,K), and gr are the cor- 
responding maximum conductances per unit area; h, m, 
n are the voltage dependent conductances; and a, /? are 
functions of V adjusted to physiological data by voltage 
clamp techniques. We have used the original functions 
and parameters employed by Hodgkin and Huxley pO[ |. 

The system was integrated using the Runge-Kutta 6(5) 
scheme with variable time step based on The abso- 
lute error was 10~^^ and the relative error was 10"'' in 
all the calculations presented in this letter. The synaptic 
current is given by 

Int)^9^JrJ{t}[Vs{t)~Es] (3) 

where i stands for the index of the neuron that receives 
the synaptic input, j is the neuron from which the synap- 
tic input is received, and is the maximum conduc- 
tance, which determines the degree of coupling between 
the two connected neurons. Vg is the postsynaptic po- 
tential, Es is the synaptic reversal potential and rj{t) is 
the fraction of bound receptors computed following the 
method and parameters described by Destexhe et al. . 
Namely, the dynamics of the bound receptors r is given 
by the equation: 

f ^ a[T]{l - r) - (3r (4) 

where [T] is the concentration of the transmitter, and a, 
f3 are the rise and decay constants, respectively. 

In this model three different kinds of connectivity pat- 
terns have been tested: regular, random and small world. 
To interpolate between regular and random networks we 
follow the procedure described by Watts and Strogatz ||] 
which we summarize here for convenience: we start from 
a ring lattice with N vertices and k edges per vertex, 
and each edge is rewired at random with probability p. 
The limits of regularity and randomness are for p — 
and p = 1 respectively, and the small-world topology 
lies somewhere in the intermediate region < p < 1. 
The quantification of the structural properties of these 
graphs is performed, following Watts and Strogatz 0, 
using their characteristic path length L{p) and their clus- 
tering coefficient C{p). L{p) is defined as the number of 
edges in the shortest path between two vertices, aver- 
aged over all pairs of vertices. C{p) is defined as follows: 
suppose that a vertex v has ky neighbours; then at most 
kv{kv — l)/2 edges can exist between them. Let de- 
note the fraction of these allowable edges that actually 
exist, and define C as the average of Cy over all vertices 
V. Fig. |l|a replicates that of Watts and Strogatz for 
ease of reference and to verify our computations. 



Next we investigate the functional significance of SW 
topologies for the dynamics of the network. Watts and 
Strogatz Q already note that small-world networks of 
coupled phase oscillators synchronize almost as read- 
ily as in the mean-field model, despite having orders 
of magnitude fewer edges. To study the global be- 
havior of the network we compute its average activity 
V{t) = (l/iV)X;^Ii Vi{t). The quantity that we use to 
detect the onset and degree of coherent oscillations is the 
average activity oscillation amplitude [ pTf , defined by 

^'{p) = 7fA^ r[{\w)),-v;{t)fdt (5) 

where Vp{t) is the average activity of the network for 
a given value of the probability p, and the angle brack- 
ets denote temporal average over the integration interval. 
A high value of cr(p) would imply a high amplitude of 
the oscillations of the average activity, while a low value 
would indicate an almost non-oscillatory behavior. In 
Fig. I^b we plot (t{p) for each of the different networks 
characterized by its probability p. Notice that coherent 
oscillations increase in the region in which a high C{p) 
and a low L{p) occur simultaneously; this is precisely the 
SW region. This can be better observed in Fig. ^, which 
shows the average activity of the network in three cases 
corresponding to the three different topological configu- 
rations: regular, random and SW. Both the regular and 
the SW topologies display coherent oscillations, but in 
the regular network they appear much later and their 
amplitude is smaller than in the SW case. On the other 
hand, the random network only displays irregular varia- 
tions over an almost constant pattern of activity. 

A more extensive study in the (fc,p) plane has been 
performed in order to stablish the limits for the appear- 
ance of coherent oscillations and to check that our previ- 
ous results can be generalized within a certain range of 
parameters. We have computed the average activity os- 
cillation amplitude for a total of 180 points in the (fc,p) 
plane, taking an integration interval between Ti — 100 
and T2 — 200. An interpolation of these results is plot- 
ted in Fig. H, where the clear zones indicate high values 
of a. We can conclude from this figure that fast coher- 
ent oscillations appear only in the region of intermediate 
probabilities, that is, the SW. The a priori limits on k 
are based on the fact that for k lower than 10 the ac- 
tivation of the network is very weak, while for k higher 
than ^ 35 some neurons become saturated. 

Having shown the necessity of a SW network to ob- 
tain a fast response along with coherent oscillations of 
the average activity, we proceed to check the ability of 
the network to produce a temporal codification of the in- 
formation contained in the stimulus, and the robustness 
of the network response to the introduction of noise in 
the input. 

In temporal coding, information is represented by the 
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timing of action potentials with respect to an ongoing col- 
lective oscillatory pattern of activity. For instance, when 
an odour is presented, every neuron in the AL responds 
to the odour with some particular timing with respect 
to the LFP As a measure of this temporal coding, 
we have divided time in periods of the global average 
activity, and calculated for each period the quantity: 



A,{n) 



1 

C 



[a,{t) - V{t)Ydt 



(6) 



where i represents a particular cluster, n a particular pe- 
riod of the mean activity V{t) of the whole network, ai{t) 
is the mean activity of cluster i, and C is an appropi- 
ate normalization constant used to get the final value of 
Ai{n) in the range — 1. 

We would expect the coding to be different for each 
cluster. In Fig. ^ we show the results for three different 
clusters chosen at random in a network within the SW 
connectivity regime. It can be observed that the activ- 
ities of the different clusters are out of phase and reach 
their maximum values at different periods of the global 
average activity. 

A system with such a coding can rapidly and efficiently 
perform computations that are essential to pattern recog- 
nition, and that are much more difficult to perform in 
a rate-coding framework [2^-|2^]. Following this coding 
scheme, information about an odour is contained not only 
in the neural assembly active at each oscillation cycle, but 
also in the precise temporal sequence in which these as- 
semblies are updated during the response to the odour. 
Temporal coding thus allows combinatorial representa- 
tions in time as well as in space 

Lastly, in order to check the robustness of the network 
response, we have computed correlations between the ac- 
tivities of a given cluster in five different realizations of 
the simulation. We have introduced a gaussian uncorre- 
lated noise to the external input: /"^ = /q + ere, where cr 
is the outcome of a normal distibution and e is the noise 
level. The correlations are calculated as follows: 



is). 



(7) 



where r and s correspond to different realizations of the 
simulation, i is the cluster, the sums are over all peri- 
ods n, and the dependence on the noise is implicit in the 
right side of the equation. We have defined the quantity 



m. 



{r)i 



[n) = A^l\n) - (Af ^}, with Afin) the magnitude 
from Eq. (^, for a particular realization r. The angle 
brackets denote average over all periods n. 

An average of the correlation curves for different pairs 
of realizations is plotted in Fig. |^. There are two clearly 
different regions in the graphic: for small amounts of 
noise the correlation is almost 1.0; whereas for a higher 
noise level the correlation jumps to a lower value. The 



discontinuity appears at a level of noise of approximately 
0.1 percent. 

In conclusion, a variety of possible network topologies 
has been investigated. Each one gives rise to different 
dynamical properties. Regular networks produce coher- 
ent oscillations and temporal coding in a slow time scale; 
whereas random networks give rise to fast response but 
without coherent oscillations. We have introduced new 
results on small-world networks, showing that both co- 
herent oscillations and temporal coding can coexist in 
synergy in a fast time scale. At the onset of this re- 
search project, intrigued by the olfactory AL dynamics, 
we were searching for a dynamical system with precisely 
the properties just described for the SW networks. Hence 
the work here reported is not only interesting from the 
dynamical systems point of view, but it is also relevant 
for the understanding of biological systems. 
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FIG. 1. (a) Characteristic path length L{p) and clustering 
coefficient C{p) for the family of randomly rewired graphs, 
normalized to the values L{0) and C(0) of the regular case, 
(b) Average activity oscillation amplitude (t(p) for the whole 
range of networks, calculated between Ti = 100 and T2 — 200. 
Both curves are averages over ten realizations of the simula- 
tion with parameters A'' = 797, fc = 30 and g = 0.015. An 
input signal 7o = 1.5 was injected, at t = 50, to 80 neurons 
randomly chosen . 



FIG. 2. Average activity in a network of 797 neurons, 
(a) Regular network (p — 0.000). (b) Small- world network 
(p = 0.032). (c) Random network (p = 1.000). The input 
onset occurs at t = 50 and is offset at t = 350. All the pa- 
rameters are as described in Fig. ^ 

FIG. 3. Phase diagram which shows the regions of oscilla- 
tory (clear, high a) and nonoscillatory (dark, low a) activity 
of the network in the {k,p) plane. The island that appears on 
the right side indicates that the SW (for some range of val- 
ues of k) is the only regime capable to produce fast coherent 
oscillations in the average activity after the presentation of 
the stimulus. All parameters are as described in the previous 
figures. 

FIG. 4. (a)-(c) Average activity of three different clusters 
of neurons promediated over periods of the global mean activ- 
ity. The simulation corresponds with that of Fig. ^b, which 
lies within the SW region, (d) Average activity of the whole 
network showing the coherent oscillations over which the ac- 
tivities of clusters are promediated. 

FIG. 5. Correlation versus noise for two simulations with 
SW connectivity, (a) p = 0.032. (b) p = 0.100. The rest 
of parameters are as described in Fig. |^. The plots were ob- 
tained as follows: we made five realizations of the simulation 
for a given e, and calculated the point as a double average; 
first an average over all possible pairs of realizations for a 
given cluster, and then an average over clusters. 
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